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NONNEGATIVE RANK DEPENDS ON THE FIELD 


YAROSLAV SHITOV 


Abstract. Let A be a nonnegative matrix with entries from a field 7^ C M. 
The nonnegative rank of A, denoted rank+(A,7^), is the smallest integer k 
such that A is a sum of k nonnegative rank-one matrices over J^. We show 
that, for some A and J^, it holds that rank+(A,7^) ^ rank+(A,R). 


In 1993, Cohen and Rothblum published the foundational paper [2], which con¬ 
tained a description of possible applications of nonnegative rank and an algorithm 
computing this function. Their algorithm was based on quantifier elimination pro¬ 
cedure, and the authors did not know whether it is applicable to compute nonneg¬ 
ative ranks over fields which are not real closed. Cohen and Rothblum posed the 
question: How sensitive is the problem to the ordered field over which it is asked? 

Problem 1. Do there exist a sub field -F C K and a nonnegative matrix A G 
such that rank+(A,-F) 7? rank+(A,K)? 

Now the nonnegative matrix factorization is one of the important problems in 
applied mathematics. It is a key tool of new techniques developed in contexts 
of data processing [6], combinatorial optimization [3], statistics [5], and several 
other topics. The computational complexity of nonnegative rank is much better 
understood now [7], and faster algorithms for solving this problem have been de¬ 
veloped [1]. However, Problem [T] remained open. The paper [4] gives a positive 
solution of a similar problem asked for positive semidefinite rank. Kubjas, Robeva, 
and Sturmfels [5] stressed the importance of describing matrices of nonnegative 
rank at most r with quantifier-free semialgebraic formulae. In the special case of 
rank-three matrices, they solved Problem [T] in the negative and constructed such 
formulae. 

In this paper, we give a positive solution of Problem[I] In particular, we will see 
that quantifier-free semialgebraic formulae cannot describe matrices of nonnegative 
rank at most five over a specific field. Many known algorithms computing nonnega¬ 
tive ranks are based on quantifier elimination procedures mm, and our result shows 
that they cannot be used for matrices over arbitrary ordered field. We start with 
a geometric reformulation of Problem (TJ its connection with the following question 
is established by standard arguments, but we list the proof for completeness. 

Problem 2. Do there exist a field .F C K and polytopes P,Qc such that: 

(1) dim P = k — 1 and P C Q ; 

(2) vertices of both P and Q have coordinates from .F; 

(3) there is a simplex A satisfying P C A C Q, and every such A has a vertex not 
all of whose coordinates belong to PI 

Proposition 3. A positive solution of Problem\^ implies that of Problem]^ 

Proof. Denote by di,... ,dk the vertices of A, by ui,...,Um the vertices of P, and 
let /i > 0, ...,/„> 0 be linear inequalities defining the facets of Q. Let A be an 
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n-by-m matrix whose ith column is the slack of Vi, that is, define Aij as fj{vi). 
Since every Vi belongs to the convex hull oi di,... ,dk, the ith column of A belongs 
to the convex hull of the slacks of di,... ,dk- 

Conversely, assume that A = BC, for some nonnegative matrices B G 
and C G , Then, since dimP = k — 1 implies rank(A) = k, we see that 

rank(_B) = k. Therefore, the columns of B (up to scaling) are affine combinations 
of columns of A. Therefore, every column of B is the slack vector of some point of 
and this point belongs to Q because B is nonnegative. □ 

Now we describe our solution of Problem [2j all the computational claims 
have been checked using Wolfram Mathematica. We define a = —0.0311..., 
/3 = —0.4088..., 7 = 0.3983... as numbers that make the polynomial 7 r(t) = 
(—96a — 96/3 — 48a/3 — 1927 — 96a7 — 96/37 + 99a/37)+t(—1392a — 1296/3 — 96a/3 — 
16967 - 1624a7 - 952/37 + 1370a^7)+t2(-256 - 8608a - 5488/3+ 1172a/3 - 55367 - 
10240a7 - 2164/37 + 4292a/37)+f3(-2944 - 25648a - 8512/3 + 4100a^ - 81927 - 
21056a7 - 1736/37 + 4768a/37)+t4(-8576 - 32288a - 4832/3 + 4072a^ - 29127 - 
12608a7 - 440/37 + 1744a/37)+t5(-3584 - 11648a - 896^ + 1120a^) G Q[t] have 
the form (—f — 2)u^, where u G M[f] has degree two; we pick r = 0.1765... to be one 
of the two roots of u. We denote P = Q{a,P,^)\ it can be checked that t ^ P. 

Our construction is four-dimensional, and we work in the affine subspace xi + 

.. .+X 5 = 1 in R®; in particular, we refer to three-dimensional planes in this subspace 
as hyperplanes. We define 0(t) = fx{l + t, 1 + 2t, 1 + t, 1, 0), Pn = An(1000 + 
514a, 1056, 524 + 131a, 772 + 193a, 648 + 162a), P 12 = Ai 2(1000 + 532a, 1128,1012 + 
253a, 236 + 59a, 624+156a), +13 = Ai3(500+233a, 432,536+134a, 176+44a, 356+ 
89a), +21 = A2i(14044 + 3511/3, 20000 + 9467^, 17868,8888 + 2222/3,19200 + 4800/3), 
+22 = A22(136 + 34/3, 200 + 98^, 192,144+36^, 128+32/3), +23 = A23(96 + 24/3,100 + 
28/3,12,72+18/3,120+30/3), +31 = A3i(26-37, 22 - 27 ,25+57,20,7), +32 = A32(17- 
37 ,22 - 27 ,25 + 57 ,20,16), +33 = A33(376 - 8 I 7 ,384 - 547 ,500 + 1357,540,200), 
+41 = A 41 (618,392,365,625,500), +42 = A42(1863,1252,1250,1875,1260), +43 = 
A43(384, 496,495,625,500), H = (3,3, 3,3,4)/16, where the coefficients are such 
that the coordinates of corresponding vectors sum to 1 . 

We write e for a sufficiently small positive number in the rest of this note. We 
choose rational numbers qiP 2 satisfying r G ( 91 , 92 ) and I 91 — 92 ] < e, and we 
define ft = ^(t) and kli = kl{qi). We let w be a point satisfying ||n — a;|| < e, and 
we set fij = {Fij — (0,0, 0,0, nij))/(l — Vij), where Vij are variables. By v = (vij) 
we denote the list of all n^’s. By 7ri(oj,v) we denote a nonzero vector orthogonal 
to w,/ii,/i 2 ,/is; then, Tri{uj,v) • a; = 0 is the equation of the hyperplane passing 
through those points. We define Vj(uj,v) as the point that lies on the intersection 
of hyperplane Xj = 0 and all hyperplanes TTi{uj,v) ■ x = 0 with i different from j. 
We write Vj = V, (0, 0). 

We define A(w, v) as the convex hull of a; and all ki(a;, vYs, and also A = A(n, 0). 
We refer to the facet of A{uj,v) not containing Vi{uj,v) as the ith facet. Further, 
we choose rational interior points IF, T+i ..., W 4 G A satisfying ||1F — n|| < e 
and \\Wi — Vi\\ < e. We define P as the convex hull of W, Wfs and +y’s. We 
also define Ai, Bi,Ci, Di as arbitrary points with zero ith coordinate such that 
C 0 TiY{Ai^ Bi,Ci, Di} has diameter less than e and contains Vi as an interior point. 
We define Q as the convex hull of fli, 0,2 and all Al^’s, Bfs, Cfs, Dfs, and we check 
that + C A C Q. Also, we check that lies outside A if and only if Vij > 0. We 
consider the function 4>(a;, v) = det {Vi{oj, v), ¥ 2 ( 0 ], v), 1 / 3 ( 0 ;, v), 14 ( 0 ;, v), H), and we 
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check that 0) = 0 and det (Fi, V 2 , V 3 , V 4 , fl) > 0. The latter condition implies 
that H lies outside A(uj,v) whenever uj and small Vij’s are such that 111 ( 0 ;, z;) < 0. 

Now let A' be a simplex; we are going to complete our proof by checking that 
P C A' C Q implies A = A'. The positions of Wi’s guarantee that A and A' get 
close one to the other as e goes to zero, so we can assume that 0 ; is a vertex of A'. 
Since A and A' are close, there is no j such that the zth facet of A' is parallel to 
the line containing all fij’s; therefore, there are small Vij for which the ith facet 
of A' passes through points fij. Since P C A', the point Fij cannot lie outside 
A'; therefore, the point fij S A' cannot be interior for A, and we have Vij > 0. 
Now we see that Vij ’s and uj are sufficient to determine the hyperplanes of all facets 
containing uj. Without a loss of generality we can assume that the vertices of A' 
belong to the boundary of Q; that is, we can assume that the vertices of A' are uj 
and Vi{uj,vys. In other words, we have A' = A{uj,v). 

It remains to prove that (fl, 0) is a local maximum of the function 111 ( 0 ;, z;) subject 
to UJ G Q and Vij > 0. We can check that partial derivatives d'^/dvij are negative 
in the point (fl, 0 ), as well as the derivatives along the directions from (n, 0 ) to 
(Ai, 0), (Si, 0), (Ci, 0), {Di, 0). Now it suffices to prove that fl is a local maximum 
of the function il'(o;, 0 ) subject to 0 ; S conv{r 2 i, n 2 }- In this case, is a rational 
function ^p(t)', this function factors as Lp(t) = y(t)TT{t), where C takes a non-zero 
value in r, and tt is a polynomial defined above. Therefore, the chosen values of 
a, /3, 7 , T are such that ip(t) has a double root in r, and it remains to check that 
^"{t) < 0 . 

One particular implication of our result is that algorithms based on quantiher 
elimination may not help to compute nonnegative factorizations over different fields. 
One can ask: Is there an algorithm computing rank_|_(A, Q), given a rational non¬ 
negative matrix A? A more specihc question asked by Cohen and Rothblum [2] is 
also open: Is the equality rank_|_ (A, M) = rank_|_(A,Q) always true? 

I would like to thank Kaie Kubjas for interesting discussions on this topic and 
helpful suggestions on presentation of the result. 
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